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PRINTING WEB PAGE IMAGES VIA A MARKED PROOF SHEET 
Cross-Reference to Related Applications 

5 

This application relates to the subject matter disclosed in the co-pending U.S. 
application Ser. No. 09/173,050 (attorney docket 10980726-2), by Winter et al., titled 
"System And Method For Printing And Scanning A User-Completed Digital Still Camera 
Image Proof Sheet And Order Form", filed May 10, 2001 as a continued prosecution 
10 application of its parent application of the same Ser. No. (attorney docket 10980726-1) 
which was filed October 15, 1998. 

This application also relates to the subject matter disclosed in the co-pending U. S. 
application Ser. No. 09/735,090 (attorney docket 10003317-1), by Winter et al, titled 
"Storing And Retrieving Digital Camera Images Via A User-Completed Proof Sheet", 
15 filed December 12, 2000 as a continuation-in-part of Ser. No. 09/173,050 by Winter et al. 

This application also relates to the subject matter disclosed in the co-pending U.S. 
application Ser. No. 09/767,935 (attorney docket 10003326-1), by Monty et al, titled 
"Specifying Image File Processing Operations Via Device Controls And A User- 
Completed Proof Sheet", filed January 23, 2001 as a continuation-in-part of Ser. No. 
20 09/173,050 by Winter et al. 

All of these applications are assigned to the assignee of the present invention and 
are hereby incorporated by reference in their entirety. 



Field of the Invention 
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The present invention relates generally to the printing of digital images, and 
pertains more particularly to systems and methods for the selection and printing of digital 
images included on Internet web pages. 

5 

Background of the Invention 

The rapidly increasing establishment of web pages by businesses, organizations, 
and individuals has resulted in the widespread usage and accessibility of digital images on 
10 the Internet Many web pages display digital images along with textual information. On 
many occasions surfers of these web pages desire to obtain a printed copy of one or more 
of these images. 

The growth of digital photography also is contributing to the presence of large 
numbers of digital images on the Internet, as photographers increasingly store their photos 
15 on-line in photo storage sites such as Hewlett-Packard Co.'s "HP Photo" web site 

(http://www.hpphoto.com). Business associates, family, and friends of a photographer 
can view the digital photos and on many occasions desire to obtain printed copies. 

Viewing and selecting images for printing is conventionally and easily done by 
connecting a computer to the Internet, viewing the desired web pages or photo storage 
20 sites using a web browser, and using the browser to select and print the images on a 
printer attached to the computer. Color inkjet printers, for example, can typically be 
purchased for a small fraction of the cost of a computer system. 
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However, some users may not need or want to own or operate a computer, but 
still would like to obtain digital images or photographs from the Internet. The user may 
not be able to afford a computer, may not feel technically proficient enough to operate it, 
or may generally have no need for it. Many of these users have found multifimction 
5 printers to be an attractive alternative to a computer system. Multifunction printers 
typically provide a fax machine, a scanner, and a copier. Certain multifunction printers 
also provide the ability to connect to the Internet, through either a dial-up Internet 
connection made over the same phone line used for the fax machine function or via an 
accessory module connected to the printer. While it would be desirable to select and print 
10 digital images using only the printer, it is currently impractical to do so in an efficient 
manner without the interactive web page viewing and image selection typically done 
through a computer. 

Some digital camera users may utilize a standalone printer solely for printing their 
digital photographs. Such printers typically provide for a connection to the digital camera, 
15 either via an electrical link or by providing a slot for a digital image memory card that can 
be removed from the camera and inserted in the printer. Certain of these printers may be 
similarly connected to the Internet. 

Accordingly, it would be highly desirable to have a new and improved printer and 
printing method that allows digital images associated with Internet web pages to be 
20 previewed, selected, and printed without the need for attaching a computer to the printer. 
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Summary of the Invention 

In a preferred embodiment, the present invention provides a method of printing 
with a printing system that allows selected digital images from web pages to be printed. 
5 The method automatically analyzes the web page to identify the image files associated 
with the page, and automatically filters the image files according to predetermined criteria 
in order to identify qualified image files. One or more of the qualified image files are then 
selected and printed. 

Alternate embodiments of the method print a proof sheet for at least some of the 
,n 10 image files associated with the web page. In one such embodiment, at least one selection 
CP area of a proof sheet corresponding to at least one of the image files to be printed is 

marked. The marked proof sheet is scanned so as to determine marked selection areas, 
1. and the image files associated with the marked selection areas are printed. In another such 

embodiment, at least one image specifier from the proof sheet is provided to the printing 
Q 15 system, and the corresponding image files printed. 

Brief Description of the Drawings 

The above-mentioned features of the present invention and the manner of attaining 
20 them, and the invention itself, will be best understood by reference to the following 

detailed description of a preferred embodiment of the invention, taken in conjunction with 
the accompanying drawings, wherein: 
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FIGS. lA-lB are schematic representations of diflferent embodiments of a printing 
system according to the present invention; 

Fia 2A is a more detailed schematic representation of the multifunction printing 
system of FIG. 1 A illustrating a subsystem block diagram of a multifunction printer in the 
system and an exemplary web page accessible by the printer; 

FIG. 2B is a schematic representation of an exemplary set of image files associated 
with the web page of FIGS. 2A and 2D, including an exemplary set of qualified image files 
and an exemplary set of selected image files; 

FIG. 2C is a schematic representation of an exemplary image file network URL 
address for one of the image files of FIG. 2B; 

FIG. 2D is a more detailed schematic representation of the printing system of FIG. 
IB illustrating a subsystem block diagram of a printer in the system and an exemplary web 
page accessible by the printer; 

FIG. 3 A illustrates a proof sheet that may be utilized with the system of FIGS. 1 A- 
IB to select one or more image files for final printing; 

FIG. 3B-3C illustrate image indicia and selection areas of the proof sheet of FIG. 
3 A for selecting image files for final printing; 

FIG. 3D illustrates an identity marker of the proof sheet of FIG. 3 A for identifying 
the network address of the image files represented on the proof sheet; 

FIG. 3E illustrates image indicia and image specifier areas of the proof sheet of 
FIG. 3 A for selecting image files for final printing; 
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FIG. 4 is a schematic representation of filter criteria usable to qualify certain ones 
of the image files of FIG. 2B for printing onto the proof sheet; 

FIG. 5 is a high-level flowchart of a novel printing method according to the 
present invention that is usable with the multifunction printing system of FIGS. 1 A-IB; 

FIG. 6 is a lower-level flowchart of acquiring according to the method of FIG. 5; 

FIG. 7 is a schematic representation of an exemplary set of web pages having 
linkages between thumbnail images and larger images that is usefiil in illustrating the 
operation of the flowchart of FIG. 8; 

FIG. 8 is a lower-level flowchart of analyzing according to the method of FIG. 5; 

FIG. 9 is a lower-level flowchart of filtering according to the method of FIG. 5; 

FIG. 10 is a lower-level flowchart of determining file characteristics according to 
the method of FIG. 5; and 

FIG. 11 is a lower-level flowchart of selecting image files according to the method 
of FIG. 5, 

Description of the Preferred Embodiment 

Referring now to the drawings, there is illustrated a printing system constructed in 
accordance with the present invention which enables digital images associated with 
Internet web pages to be previewed, selected, and printed without the need for a computer 
attached to the printer. The printing system preferably includes subsystems which obtain 
certain image files associated with a specified web page, print a proof sheet associated 
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with those images, allow the user to select which of the images are to be printed, and print 
these user-selected image files. In operation according to a preferred embodiment of a 
novel method of printing of the present invention, the web page is acquired and analyzed 
to identify image files associated therewith. The image files are filtered according to 
5 qualifying criteria, and one or more are selected for printing. The selected images are then 
obtained and printed. 

As best understood with reference to FIGS. 1 A and 2A-C, a presently preferred 
embodiment of the printing system 10 includes a multifianction printer 14 having both 
\i printing and optical scanning capabilities. The printer 14 is connectable to a network 205, 

m 10 such as the Internet, over network link 201 . The network 205 provides access to web 
^2 pages, such as exemplary web page 8, which the printer 14 can dovmload over network 
:^ link 20 1 . The printer 14 is manually operable by one or more of the plurality of 

pushbuttons 32 on the printer 14. Some of the pushbuttons 32 may be configured as 
p "speed dial" buttons which, when operated, cause the printer 14 to connect to the network 

Is, 

15 205 and/or request a specific web page, such as web page 8, fi^om the network 205. A 
display 34 provides feedback to the user about the operation of the printer 14. 

The web page 8 may be associated with one or more digital image files, such as 
exemplary image files 4. The web page 8 and the digital image files 4 are typically stored 
on a computing apparatus 28 which is connected to the network 205 by network link 203. 

20 A representation 9 of the web page 8 and the image files 4 may be rendered on a computer 
monitor (not shown) of computing apparatus 28 by a web browser (not shown); image 
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files 4a-4a are rendered as images 6a-6e respectively. Some of the digital image files 4 
may be digital photographs taken by a digital camera 12, Digital image files 4 may be 
transferred from the camera 12 to the computing apparatus 28 over a data link 20, or 
alternatively the image files 4 may be stored on a removable memory device 16 (such as a 
5 memory card) which can be removed from the camera 12 and inserted into a compatible 
card reader (not shown) on the computing apparatus 28. 

Considering now in further detail the preferred embodiment of the multifianction 
printer 14, the printer 14 includes an internet access subsystem 70. The internet access 
subsystem 70 communicates with the network 205 to obtain the web page 8 and image 

10 files 4 using the appropriate network stack and protocols, such as http (hypertext transfer) 
protocol, known to those skilled in the art. The desired web page's network address (also 
known as a URL) 72 is provided to the internet access subsystem 70. As is known to 
those skilled in the art, a URL for exemplary web page 8 might be 
"www. website. com/MyPix/MyWebPage.html" . 

15 The URL 72 is preferably prestored to one of the "speed dial" pushbuttons 32 

previously described. Alternatively, others of the pushbuttons 32 may be configured as an 
alphanumeric keypad for specifying the web page URL 72. When the "speed dial" 
pushbutton 32 corresponding to the desired web page 8 is operated, or the corresponding 
alphanumeric data entered at the keypad, the web page URL 72 is communicated to the 

20 internet access subsystem 70. In response, the internet access subsystem 70 retrieves the 
source code file (typically containing text in a markup language such as HTML) for the 
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web page 8 from the network 205 and sends it to a webpage analyzer subsystem 74. The 
web page analyzer subsystem 74 parses the markup text to identify image file URLs 73 for 
the image files 4 associated with the web page 8 and, as will be discussed subsequently in 
greater detail, obtains certain ones of the image files 4 fi*om the network 205. Which ones 
5 of the image files 4 are to be obtained is determined by filtering criteria 76 established by 
the user, preferably through operation of others of the pushbuttons 32 which specify the 
filtering criteria 76. The web page analyzer subsystem 74 applies the filtering criteria 76, 
which also will be discussed subsequently in greater detail, to the set of image files 4 
^ associated with the web page 8, in order to determine which are the qualified image files 3 
CP 10 that satisfy the fihering criteria 76. Then the web page analyzer subsystem 74 provides the 
image file URLs 73 for the qualified image files 3 to the internet access subsystem 70 in 
order to obtain the qualified image files from the network 205, and when the qualified 
ry image files 3 are obtained, communicates both the qualified image files 3 and their 
O corresponding image file URLs 73 to an image proofing subsystem 78. 

1 5 The image proofing subsystem 78 then forms the content of a user-markable proof 

sheet 22 for the qualified image files 3. As will be discussed subsequently in further detail, 
the proof sheet 22 includes an indicia 52 (such as a thumbnail image and/or a filename) for 
each qualified image file 3, and a user-designation area 54 associated with each indicia 52. 
As will also be discussed subsequently in greater detail, at least one identity marker 60 
20 indicative of the image file URLs 73 for the qualified image files 3 is also formed on the 
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proof sheet by the image proofing subsystem 78. The image proofing subsystem 78 sends 
the proof sheet content to a printer subsystem 80 which produces the proof sheet 22. 

After the user chooses selected ones of the qualified image files 2 for printing by 
marking the user-designation areas 54 associated with the indicia 52 of the selected image 
5 files 2, the user places the marked proof sheet 22 on a scan platen 122 where it is optically 
scanned by a scanner subsystem 86. The scanned image is communicated fi-om the 
scanner subsystem 86 to a proof sheet analyzer subsystem 82. The proof sheet analyzer 
subsystem 82 detects and interprets the markings made by the user in the user designation 
areas 54 (also known as image selection areas 54) to identify the user-selected image files 

10 2, and associates each of the individual user designation areas 54 with a corresponding 

image file URL 73 via the identity marker 60. The proof sheet analyzer subsystem 82 then 
provides the image file URLs 73 to the internet access subsystem 70 in order to obtain the 
user-selected image files 2 fi*om the network 205. When the image files 2 have been 
retrieved, the proof sheet analyzer 82 sends them to an image printing subsystem 84 along 

15 with the printing instructions marked by the user in the user-designation area 54 for each 
image file. These printing instructions generally include print size, as will be discussed 
subsequently in greater detail, and may also incorporate other instructions such as border 
size and color, rotation, brightness, image color shade, and print media type. The image 
printing subsystem 84 renders each image file 2 according to the printing instructions, and 

20 sends the print content to the printer subsystem 80 for generating the image prints 26. 
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Considering now the differences between the preferred embodiment described 
heretofore and an alternate embodiment of the printing system 10, and as best understood 
with reference to FIGS. IB and 2D, the alternate printing system 10 includes a printer 14* 
rather than the multifunction printer 14. Printer 14' does not include a scanner subsystem 
5 86 or a scan platen 122. The proof sheet 22' does not include a user designation area 54, 
but rather includes an image specifier 54' associated with each image indicia 52. In order 
to generate an image print 26 for an image file 2, the image specifier 54' associated with 
the image file 2 is communicated to the printer 14'. Preferably this is done via pushbuttons 
32, and in conjunction with prompts presented on display 34, of the printer's user interface 

10 under control of the image specifier subsystem 82'. An interactive dialog is typically used 
to specify the other printing instructions, such as print size and print media type, as well. 

The above-described subsystems 70,74,78,80,82,82',84,86 are preferably 
implemented in firmware or software stored on a program storage medium such as a 
ROM, CD-ROM, or the like and executable by a processor or microcomputer (not shown) 

15 disposed within printer 14,14'. Alternatively, subsystems 70,74,78,80,82,82',84,86 may be 
implemented in printer hardware such as discrete logic or an ASIC, or in a combination of 
firmware, software, and hardware. 

Considering now in fiirther detail one preferred embodiment of the user-markable 
proof sheet 22, Fig. 3 A is a detailed plan view of an exemplary combination proof sheet 

20 and order form 22 that may be utilized with the system 1 0 of Fig. 1 A to select one or more 
images fi*om an array of thumbnail images such as 52 (Fig. 3C) for final printing. By way 



Patent Application 
10011763 

- 12- 

of example, there are twenty-five thumbnail images labeled 'T' in Fig 3 A arranged in an 
array of four rows and eight columns on the form 22. The term "thumbnail" is a term of 
convenience used to describe printed graphical representations of reduced size and/or 
quality that are suflFiciently small so that an array of the same can be printed on a single 
5 sheet of paper for simultaneous viewing and evaluation by a user. The thumbnail images I 
are preferably printed in color, although they could be black and white. They are made up 
of microscopic pixels of color pigment applied in a well known manner to achieve the 
image definition, tone, shading, resolution and other image characteristics required. It will 
be understood that the thumbnail images I are typically of lower quality than the final print 

10 images. The thumbnail images are displayed in an array to allow the user to quickly and 
easily select which of the digitally stored images transferred from the camera 12 that he or 
she wants to print in final, higher quality form. 

The combination proof sheet and order form 22 (Fig. 3 A) includes image selection 
user designation areas such as 54 (Fig. 3C) adjacent each of the thumbnail images L The 

15 user designation areas 54 include rows and columns of bubbles 56 that can be manually 
filled in by a user with a pen or a pencil. Other discrete regions could be utilized as user 
designation areas such as vertical stripes or slots between two adjacent vertical bars. The 
user designation areas could consist of discrete bounded regions in which a user could 
write in print or cursive form numbers, digits or symbols that could be read with optical 

20 character recognition (OCR) software. Alternatively, a user could punch out holes or 
apply stickers or conductive markers. Besides optical scanning, the printer could use 
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electrical or mechanical detection of the completed user designation areas. The user 
designation areas 54 of the form 22 also include user readable printed indicia in the form 
of the column headings "Size" and "Qty" (quantity) in addition to row headings "3.5x5", 
"4x6", "5x7", "8x10" and "Cstm". The user designation areas are labeled "B" in Fig. 3 A. 
The user can fill in one or more bubbles 56 in the user designation area B adjacent a 
particular thumbnail image I to "order" the desired number and size of final prints of that 
digitally stored image. 

An "All Pictures" user designation area 64 (Figs. 3 A and 3B) is printed on the 
upper left corner of the form 22. It has no thumbnail image but has the Size and Qty 
indicia and associated bubbles to allow the user to order that all portrayed thumbnail 
images I be printed in particular sizes and quantities. 

Considering now in fiarther detail one preferred embodiment of the identity marker 
60, and referring again to Fig. 3 A, a preferred embodiment of the combination proof sheet 
and order form 22 fiarther includes at least one identity marker 60. The identity marker 60 
represents the image file URL 73 for each qualified image file 3 associated with the indicia 
52 on the proof sheet 22. In one preferred embodiment, the identity marker 60 may take 
the form of a checkerboard grid as shown in Fig. 3D. The identity markers 60 individually 
or collectively contain a unique pattern associated with the set of digital images 3 used to 
generate the proof sheet 22. As best understood with reference to FIG. 1 A, the 
combination proof and order sheet 22 can be advantageously used in a system 10 
according to the present invention to retrieve the digital images associated with the web 
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page 8 for printing. When a marked proof sheet 22 is placed on the scan platen 122 and 
optically scanned by the multifunction printer 14, the multifiinction printer 14 also detects 
and interprets the markings made by the user in the image selection user designation areas 
54, associates each of the individual image selection user designation areas 54 with a 
5 corresponding digital image using the identity marker 60, and carries out the operations 
specified by the user on the associated digital images. 

The checkerboard pattern preferably contains light and dark areas of a non- 
numeric graphical pattern, easily detectable by the scanner subsystem 86, which are 
encoded according to conventional means with the image file URLs 73 for the qualified 
10 image files 3 represented by the indicia 52. The scanned representation of the graphical 
pattern is converted by the proof sheet analyzer subsystem 82 into the qualified image file 
URLs 73. 

Instead of a checkerboard pattern, the identity marker 60 may alternatively be 
implemented as printed text. The printed text preferably contains text strings, each text 
15 string containing one or more qualified image file URLs 73. The scanned representation 
of the text strings are easily detectable by the scanner subsystem 86 and convertable by the 
proof sheet analyzer subsystem 82 via conventional optical character recognition into the 
qualified image file URLs 73, 

A single identity marker 60 may be used for all URLs or, ahematively, the URLs 
20 may be split among multiple identity markers 60. An example of muhiple identity markers 
60 is to have an identity marker for each image file URL 73 printed adjacent to the indicia 



Patent Application 
10011763 

- 15- 

52 and selection area 54 for that image file. Where the identity marker 60 is alphanumeric 
text, it can provide a human-readable indication to the user of the location of the network 
205 of the associated image file. 

Encoding the URLs into identity markers 60 that are printed on the proof sheet 22 
5 allows the user may choose to store the proof sheets 22, or copies thereof, in a proof sheet 
archive 126 for convenient access at a future time when image file retrieval and printing is 
desired. 

In an alternate embodiment of the user-markable proof sheet 22 of FIG. 3 A usable 
with printer that do not include scanning capability, and with reference to FIG, 3E, the 

10 proof sheet 22 includes an image specifier 54' along with each image indicia 52. The 
image specifier 54' is preferably an alphanumeric character string (such as the illustrated 
numeric character string "25") that can be entered into the printer 14' via pushbuttons 32, 
Alternatively, the image specifier 54' could be the image file URL 73; however, since the 
URL 73 is typically quite long, it is generally more convenient to enter via pushbuttons 32 

1 5 a shorter designator rather than the URL 73 . Also, it is generally more convenient to use 
a numeric rather than an alphanumeric designator for the image specifier 54', since 
entering alpha characters may be more difficult or not supported on some printers 14'. 
Another alternative method of entering the image specifier 54' is to implement a menu 
system with the display 34 and pushbuttons 32; in such an implementation, the display 34 

20 could present the image specifiers 54' for the images on the proof sheet 22 to the user, and 
the user could scroll through them and select desired ones using the pushbuttons 32. 
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An embodiment of the proof sheet 22 that uses the image specifier 54' of FIG. 3E 
will typically omit the identity marker 60, since images are selected for printing by user 
interaction with the pushbuttons 32 and display 34 of the printer 14' rather than by 
scanning the proof sheet 22 on multifunction printer 14, Instead, the image proofing 
5 subsystem 78 communicates to the image specifier subsystem 82* the correlation between 
each image specifier 54' and the web page URL 73 of the qualified image file 3 associated 
with the image specifier 54'. When the image specifier 54' of a selected image file 2 is 
entered, this correlation is used identify the web page URL 73 and retrieve the selected 
r| image file 2, 

IP 10 Before considering in fiirther detail the filtering criteria 76, it is useful to consider 

y the markup language for the web page 8. As is known to those skilled in the art, HTML 
1. (hypertext markup language) source code is ASCII-formatted, with the markup 
ly commands (or "tags") delimited by a pair of lefl: and right arrows, such as "<tag>". The 
p tags themselves are alphanumeric characters. Some tags are used in pairs, with an opening 
15 tag preceding and a closing tag following the text they operate on - for example, 

<CENTER>Text</CENTER>. Other tags include additional text within the left and right 
arrows. For example, the <IMG SRO tag generally used to identify image files 4 for 
display on the web page 8 include the image file URL 73 within the tag - for example: 



20 



<IMG SRC=''http://www.website.com/MyPix/Yosemite.jpg'' height=400 wiclth=200> 
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The file type portion of the URL 73 (" jpg") identifies the URL as denoting an 
image file 4. Types of image files 4 commonly used with web pages 8 include but are not 
limited to JPEG images (denoted by the file type portion " jpg") and GIF images (denoted 
by the file type portion ".gif ). 
5 Other text within the tag may give additional information about the image. For 

example, the *'height=400 width=200" portion of the tag specifies the size in pixels of the 
image 6 as it will appear on the rendered web page 9. This rendering height and width 
Pl typically indicates the minimum image size of the corresponding image file 4 because, 
k§ while an image file 4 may be scaled down on the rendered web page 9, in most cases it will 
IP 10 not be scaled up because of the degradation in image quality that generally resuhs. 
-J Considering now in further detail the filtering criteria 76 with reference to FIG. 4, 

g and bearing in mind the preceding discussion of HTML source code, the image files 4 
III associated with the web page 8 can be filtered against one or more of the filtering criteria 
C3 76a-f to determine the qualified image files 3 solely based on the HTML markup text of 
1 5 the web page 8. Each of the filtering criteria 76a-f corresponds to a file attribute of the 
image files 4. The webpage analyzer subsystem 74 may logically- AND the criteria, 
logically-OR the criteria, or allow the user to specify the relationship among the criteria 
76a-f 

Filtering criteria corresponding to some image file characteristics, such as image 
20 file type filter criteria 76a and rendered image size filter criteria 76c for the web page 
images 4, can be performed based on the web page HTML source. For example, since 
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GIF files often contain small icons and buttons rather than photographic images, the image 
file type filter criteria 76a might be set to filter out GIF files. Similarly, since small images 
that must be scaled up to photographic print sizes generally will not produce a print 26 
with high image quality, the rendered image size filter criteria 76c might be set to filter out 
5 files with less than a specified height, width, or combination thereof. 

Additionally, since the image file URL 73 is included in the <IMG SRC> tag, 
filtering based on one or more image file URL filter criteria 76f can also be performed 
based on the HTML markup text of web page 8. For example, the user might only be 
interested in image files from a particular web site (e.g. "www.websitexom"), a particular 

10 subdirectory (.eg. "MyPix"), or with a particular filename. Preferably the webpage 
analyzer subsystem 74 implements wild-card processing (e.g. " Yose*'*), in order to 
provide a high level of filtering capability. If the file name incorporates the date the image 
file 4 was created, as is done for image files 4 created by some digital cameras 12, then the 
image file URL filtering criteria 76f can filter based on dates. The webpage analyzer 

15 subsystem 74 may also implement relational searching (e.g. "before 1/1/2000") in such 
circumstances. 

Other image file characteristics used for filtering, however, cannot be determined 
solely fi-om the HTML markup text of the web page 8. For example, the user might only 
be interested in printing image files of a certain file size, or with certain image properties 
20 such as a 24-bit color image or a low image compression ratio. These characteristics can 
be ascertained only after obtaining the image file 4 fi-om the network 205 and examining it 
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further. Therefore, if the user selects filter criteria such as these, the webpage analyzer 
subsystem 74 provides the URLs for all otherwise-matching files to the internet access 
subsystem 70, which downloads the image files 4 from the network 205 to the printer 
14,14*. 

5 Once the image files 4 are downloaded, the webpage analyzer subsystem 74 can 

determine the file size, typically in bytes, of each image file 4. The image file size filter 
criteria 76b can be used in a similar manner to the rendered image size filter criteria 76c, 
but typically with more confidence as to the probability that the image file 4 will produce a 
print 26 of high quality, particularly when the image file size filter criteria 76b is used in 

10 combination with image property filter criteria 76d such as a true color image and a low 
image compression ratio. 

The textual information filter criteria 76e ascertains and uses textual information 
associated with the image file 4 for filtering purposes. The textual information is 
preferably indicative of the nature of the image. The textual information may be contained 

15 in a header portion of the image file 4 as is, for example, frequently done with JPG files. 
The textual information may also be contained in a shadow file having the same web page 
URL 73 as the image file 4, except for a different predetermined file extension, such as 
".txt". The textual information may alternatively be derived from a contextual analysis of 
the HTML markup text of web page 8. For example, many web pages 8 include a caption 

20 or other explanatory information adjacent an image 6, and by analyzing the way the web 
page 8 will be spacially rendered by a web browser, the textual information related to the 



Patent Application 
10011763 

-20- 

image file 4 for the image 6 can be ascertained. Once the textual information is obtained, 
filtering can be done in a similar manner as has been described heretofore for the image 
URL filter criteria 76f 

To illustrate the filtering operation performed by the webpage analyzer subsystem 

5 74, and with reference to the exemplary image files for web page 8 as illustrated in FIG. 
2B, image files 4a-4c are JPG files, while image files 4d-4e are GIF files. Each image file 
4 also has the indicated relative size, with image file 4a the largest and image file 4d the 
smallest. The exemplary filtering criteria qualifies files that have file type 76a = JPG and 
image size 76b greater than threshold 90. While image files 4a,b,c,d have a size greater 

10 than threshold 90, only files 4a,b,c are JPG files. Therefore the set of qualified image files 
3 consists of files 4a,b,c. 

Filtering operations performed using only the markup text of web page 8 are 
generally faster than filtering performed using the image files 4, because typically there are 
multiple image files 4 for each web page 8, and because at least some of the image files 9 

15 are ofi:en bigger than the file of web page 8. However, in some cases fihering performed 
on the image files 4 instead of or in addition to the web page 8 often provides more 
accurate results, because, for example the contextual analysis of web page markup text 
may be inaccurate, or more detailed textual information is contained in the image files 4 
than in the markup text of web page 8. The webpage analyzer subsystem 74 may take 

20 advantage of this by enabling a filtering setting that chooses either a "fast" filter that filters 
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only based on the markup text of web page 8, or an "accurate" filter that filters based on 
both the content of image files 4 and web page 8. 

Another embodiment of the present invention, as best understood with reference to 
FIG. 5, is a novel printing method 100 for producing desired image prints 26 on a 
5 multifunction printing system 10. The method 100 begins at 102 with electronically 

acquiring the web page 8. At 104, the web page 8 is analyzed to identify the image files 4 
associated with the web page 8. At 106, the image files 4 are filtered according to 
predetermined qualifying criteria 76 so as to identify qualified image files 3. At 108, at 
least one of the qualified image files 3 are selected. At 1 10, the selected qualified image 

10 file or files 2 are electronically obtained. At 112, the selected qualified image files 2 are 
printed, and the method 100 concludes. 

Considering now in fixrther detail the acquiring 102 of the web page 8, and with 
reference to FIG. 6, at 1 14 a web page identifier is provided. At 1 16, the markup text for 
the web page that corresponds to the web page identifier is downloaded and the acquiring 

15 102 concludes. The downloading is preferably accomplished by performing an http 

(hypertext transfer protocol) dialog to obtain the text, although it could be accomplished 
by other means such as performing an ftp (file transfer protocol) dialog. 

Before considering in fiirther detail the analyzing 104 of the web page 8, it is 
usefiil to consider, with reference to FIG. 7 the implication on the present inventive 

20 method of the hyperlinking capability of web pages using hypertext transfer protocol. 
Hyperlinking allows the user to jump from viewing a first web page 89 to viewing a 
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second web page 92 merely by selecting a particular rendered element of the first web 
page 89. Among the rendered elements may be a section of text, or an image. Using one 
image 7a as the hyperlink to another image 6a has advantageous application for 
photographic image web sites with which the present invention is particularly useful. For 
5 example, photo sites fi*equently include an index web page 88 that, when displayed as 
rendered web page 89, contains a number of small photographic thumbnail images 7, 
similar to the indicia 52 produced on the proof sheet 22 of the present invention. When 
Q the user selects one of the thumbnails 7 on this rendered index web page 89, another 
^ rendered web page 92 appears. This rendered web page 92 typically contains a single 

CP 10 larger (or full-size), more detailed, higher quality image 6. When a user wishes to print a 
,J proof sheet 22 for the photo web site, it is advantageous to specify the web page URL 72 
p. of the index web page 88, so that he can obtain a proof sheet 22 for a large number of 
ry images at a time, rather than just a single image. However, when the user marks this 
O proof sheet 22 to indicate the images 4 for which he desires to produce prints 26, he does 
15 not want to have the small thumbnail image files 5 printed, but rather intends that the 
larger, higher quality image file 4 associated with each small thumbnail image file 5 be 
used for making the prints 26. 

In order to achieve the high-quality prints 26 intended by the user, it is necessary 
for the method 100 to not only detect (e.g. by searching for "<IMG SRC>" tags) 
20 thumbnail image files 5 that will be displayed as thumbnail images 7 on the rendered web 
page 89 corresponding to the web page URL 72, but also to examine the markup text of 



Patent Application 
10011763 

-23 - 

web page file 88 adjacent the *'<IMG SRO" tag of each thumbnail image file 5 in order to 
ascertain other larger, higher quality image files 4 that will not be displayed on the 
rendered web page 89 but which can be subsequently rendered upon activation of a 
hyperlink associated with the thumbnail image file 5. The following exemplary marlcup 
text fi:-agment from an index web page 88 forms a basis for illustration: 

<A HREF="lmageFile_4a.jpg"> 

<IMG SRC="ThumbnailFile_5a.jpg" WIDTH=80 HEIGHT=40> 

</A> 

In this markup text fragment, the image file 'ThumbnailFile_5a jpg" 5a is a 
thumbnail image file contained within an •'<IMG SRC>" tag. The rendered thumbnail 
image 7a for the thumbnail file 5a will be displayed on the rendered index web page 89. 
Surrounding the "<IMG SRO" tag is a hyperlink, consisting of starting ("<A HREF>") 
and ending ("</A>") tags. The inclusion of the hyperlink "HREF=ImageFile_4a.jpg" 
within the starting tag denotes that, when the rendered thumbnail image 7a is selected on 
the rendered index web page 89, the larger image file "ImageFile_4a.jpg" 4a will be 
displayed as rendered image 6a, replacing the rendered index web page 89 on the display. 
Therefore, by parsing the markup text of the web page 88 to determine associations such 
as hyperlinks for image files, the image files associated with the web page 88 may be 
determined, regardless of whether any particular image file will or will not be rendered at 
the same time as the web page 88 is rendered. 
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It should also be noted that, instead of using a JPG file as the target of a hyperlink 
tag, a web page file 8' associated with the larger image file 4a could alternatively be 
hyperlinked to the thumbnail image 7a by including "HREF=WebPage,html" in the starting 
tag. This would allow, for example, a caption or other information 93 about the larger 
5 image file 4a to be displayed along with the larger rendered image file 6a on the rendered 
web page 9'. 

It should fiirther be noted that printing a proof sheet 22 for a web page, such as 
index web page 88, that contains a large number of images may result in multiple pages of 
^ proof sheets 22, if all the image indicia 52 and selection areas 54 cannot fit on a single 

CP 10 page. If this situation occurs, each of the muhiple pages of proof sheets 22 would 
H preferably include hs own identity marker 60, so that each proof sheet page 22 would be 

individually usable to produce prints 26. 
r|i Returmng now to consider in fiirther detail the analyzing 104 of the web page 8, 

p and with reference to FIGS. 7 and 8, at 130 the markup text of the web page is parsed to 
15 identify an image file pathname or URL 73 embedded in the markup text. Preferably this 
pathname 73 is the image file URL contained within an "<IMG SRC>" tag. At 132, the 
relationship of the pathname 73 to the corresponding image file 4 is determined. 

If the pathname 73 directly specifies the image file (as is the case in web page file 
8' for image file 4a), then at 134 (via the "Rendered" branch of 132) the embedded 
20 pathname is denoted as the pathname of the image file. Conversely, if the pathname 73 
indirectly specifies the image file (as is the case in web page 88 for thumbnail file 5a which 
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then is hyperlinked to image file 4a), then at 136 (via the "Hyperlinked" branch of 132) the 
markup text is processed to determine the other pathname associated with the embedded 
pathname, and at 138 the other pathname is denoted as the pathname of the image file. 

Regardless of the branch taken at 132, the method continues at 140. If more 
5 markup text remains to be processed ("Yes" branch of 140), then the analyzing 104 
branches to 130. If all markup text has been processed ("No" branch of 140), the 
analyzing 104 concludes. 

Considering now in further detail the filtering 106 of the image files 4, and with 
reference to FIG. 9, at 144 at least one file characteristic associated with the image files 4 
10 is determined. These file characteristics may include file type, file name, file size, image 
size, image properties, and/or textual information associated with the image file. At 146, 
for each image file 4 the at least one file characteristic is compared to corresponding 
predetermined qualifying (or filtering) criteria 76. At 148, those image files for which the 
at least one file characteristic matches the predetermined criteria 76 are denoted as 
1 5 qualified image files 3 . 

Considering now in fiirther detail the determining 144 of the file characteristic, and 
with reference to FIG. 10, at 152 the type of the at least one file characteristic associated 
with the image files 4 is determined. If the file characteristic is determinable fi-om the 
markup text for the web page 8, then at 154 the file characteristic is identified from the 
20 contents of the text source of the web page 8, without requiring that the image files 4 
themselves be acquired, and the determining 144 concludes. Conversely, if the file 
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characteristic is determinable only from the contents of the image file 4, then at 156 the 
image files are acquired, and at 158 the file characteristic is identified from the contents of 
the image files 4, and the determining 144 concludes. The types of file characteristics 
determinable from the markup text for the web page 8, and the types of file characteristics 
5 determinable only from the image files 4, have heretofore been discussed. 

Considering now in fiirther detail the selecting 108 of at least one of the qualified 
image files 3, and with reference to FIGS. 1 1, 3 A, 3C, and 3E, at 161 the mode by which 
qualified image files are selected for printing is determined. If a proof sheet 22 containing 
user selection areas 54 is to be printed, marked by the user, and scanned ("Mark Proof 

10 Sheet" branch of 161), then at 162 the proof sheet 22 for the qualified image files 3 is 
printed. The proof sheet has an image representation 52 and a corresponding selection 
area 54 for each qualified image file 3, and an identity marker 60 indicative of the web 
location 73 of each qualified image file 3. At 164, the selection areas 54 corresponding to 
the qualified image files 3 are marked. Typically this is done using a marker such as a pen 

15 or a pencil. At 166, the marked proof sheet 22 is optically scanned to form a scanned 
image. At 168, the scanned image is processed to determine the qualified image files that 
were selected for printing, and to determine the web location 73 of each of the selected 
qualified image files 2 to be printed. After this, the selecting 108 concludes. 

Conversely, if a proof sheet 22 containing image specifier areas 54' is to be printed 

20 ("Provide Image Specifiers" branch of 161), then at 172 a proof sheet 22 for the qualified 
image files 3 is printed. The proof sheet 22 contains an image representation 52 and a 
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corresponding image specifier 54' for each qualified image file 3. Each image specifier 54' 
is correlated to the web location of the corresponding qualified image file 3. At 174, at 
least one of the image specifiers 54' corresponding to the qualified image files 3 to be 
printed (eg. the selected qualified image files 2) is selected. At 176 the web location 73 of 
5 each of these selected image files 2 is determined. After this, the selecting 108 concludes. 

The method 100 is preferably performed by the printer 14,14', and are preferably 
implemented in firmware or sofl;ware stored on a program storage medium (not shown) 
such as a ROM, CD-ROM, or the like and executable by a processor or microcomputer 
(not shown) disposed within printer 14,14'. Alternatively, method 100 may be 

10 implemented in printer hardware such as discrete logic or an ASIC, or in a combination of 
firmware, software, and hardware. 

From the foregoing it will be appreciated that the printing system and method 
provided by the present invention represent a significant advance in the art. Although 
several specific embodiments of the invention have been described and illustrated, the 

15 invention is not limited to the specific methods, forms, or arrangements of parts so 
described and illustrated. The invention is limhed only by the claims. 



